@ 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



® Publication number: 



0 498 082 A1 



@ Application number: 91200194.8 
@ Date of filing: 01.02.91 



EUROPEAN PATENT APPLICATION 

(£) int CI s G06F 3/033 



(^3) Datfi of nuhliration of ^nnlipatinn* 






12.08.92 Bulletin 92/33 




Groenewoudseweg 1 






NL-5621 BA Eindhoven(NL) 


@ Designated Contracting States: 


® 




DE FR GB IT 


Inventor: Anderson, Lisa Chevanne 






c/o Int. Octrooibureau B.V., Prof. Hulstlaan 6 






NL-5656 AA Eindhoven(NL) 






Inventor: Holman, Kathleen Louise 






c/o Int. Octrooibureau B.V., Prof. Holstlaan 6 






NL-5656 AA Eindhoven(NL) 






Inventor: Van Swaaij, Maurice Gerardus 






Bernardus Franciscus 






c/o Int. Octrooibureau B.V., Prof. Hulstlaan 6 






NL-5656 AA Eindhoven(NL) 






Representative: Schouten, Marcus Maria et al 






Internationaal Octrooibureau B.V., Prof. 






Holstlaan 6 






NL-5656 AA Eindhoven(NL) 



0 Apparatus for the interactive handling of objects. 



@ In an apparatus for handling objects such as 
dccuments and Louis a menu or options (30) is 
displayed, which options (31a-,.31h) are placed in a 
curved band (31) around the position of the cursor at 
the moment of activating the menu. The shape of 
the curved band is optimized for the movement of a 
hand-held pointer device, such as a stylus, and 
allows easy movement of the pointer device along 
^ the options. The band (31) may follow part of the 
^ circumference of a circle of which circle inner por- 
^ tions (32, 33) may be used for the display of several 
00 sets of sub-options. 
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The invention relates to an apparatus for the 
interactive handling of objects, such as electronic 
docunnents and tools, which apparatus comprises a 
viewscreen for displaying thereon a menu of op- 
tions and a pointer device for pointing at a cor- 
responding area from a plurality of corresponding 
areas each associated with one of the options 
displayed on the viewscreen, and thereby selecting 
one of said options. 

Such an apparatus or workstation is generally 
used for preparing, modifying and storing docu- 
ments or sets of data in the form of electronical 
files kept in a dedicated or general purpose com- 
puter system. By entering commands to the input 
devices of the workstation documents are retrieved 
from a storage device, amended, copied, stored 
again in the storage device, etcetera. When the 
workstation is connected to other workstations by 
means of a local or public network, for example via 
telephone lines, documents can be transmitted to 
other workstations to be read by a person using the 
other workstation. For all these activities a number 
of tools are necessary to copy, transmit, store, 
etcetera the documents and sets of data. In the 
frame of the present application these tools, docu- 
ments and the necessary supplemental executable 
programs and data are indicated with the general 
term objects. Documents are, for example, text 
documents, available as a string of characters, 
graphic documents available as a (compressed) bit 
map or a set of tabular or algorithmic data, voice 
documents in the form of digitized sound. A docu- 
ment may even take the form of an executable 
program. Relations between documents may exist 
and documents may comprise both text, graphic 
and sound data. Other kinds of objects are, for 
example, programs emulating a calculator, agenda, 
calendar and telephone directory or communication 
equipment, as a telephone or fax. In a workstation 
the objects are indicated on the screen much in the 
way objects are present on a desktop. 

For the handling of the objects, selections have 
to be made. Both the selection of an object and the 
selection of an adjustment or an operation on the 
object. Such selections are commonly made by the 
display of a menu on which a number of available 
options is displayed, subsequently one of the op- 
tions is selected by means of a pointer device such 
as dedicated keyboard buttons, a mouse or a sty- 
lus and digitizing tablet. 

A menu is conventionally displayed in the form 
of vertical columns or horizontal rows of which the 
length is defined by the number of options. An 
example of such a menu is disclosed in GB-A 2 
166 627. In choosing an option from such a menu 
the pointer device has to be moved over a path 
substantially corresponding to the horizontal or ver- 
tical lines along which the options are arranged. 



The human physiology is not well adapted to move 
a pointer device such as a mouse or a stylus along 
straight lines over predetermined paths and dis- 
tances. This inconvenience may lead to frequent 

5 errors in selection and make a carefully visual 
inspection necessary before giving a command to 
the workstation that the presently indicated option 
is the desired one. 

It is, inter alia, an object of the invention to 

70 provide an apparatus according to the introductory 
paragraph whereby the menu of options is dis- 
played and whereby movements on or by the 
pointer device are adapted to hand movements that 
a human operator can make and remember easily. 

15 An apparatus in accordance with the invention is 
therefore characterized in that the apparatus com- 
prises means for displaying the options on the 
viewscreen in a curved band and in that the cor- 
responding areas are positioned in a corresponding 

20 band which is curved similar to the curved band on 
the viewscreen. While working with a pointer de- 
vice such as a mouse or a stylus it is more easy to 
target area's along a curved line around a central 
area located somewhere beneath the hand of the 

25 operator on a desk than to follow substantially 
straight lines. Also travel of the pointer device from 
the centerpoint is reduced and it is easier to re- 
member the position of each option by utilizing 
motor and spatial memory. 

30 It is remarked that it is known per se from the 

"Fourth USENIX Computer Graphics Workshop" 
Cambridge, MA, 8-9 October 1987, page 103 of the 
minutes, to use a pie menu whereby choices are 
presented as sectors of a circle around the cursor 

35 position, so that the direction of the movement 
from the centre of the pie menu outwards cor- 
responds to a choice. It is not known from said 
disclosure to arrange the options in curved bands, 
of which the curvature is adopted to an easily 

40 performed movement of a hand-held pointer de- 
vice. 

An embodiment of the apparatus according to 
the invention is further characterized in that the 
apparatus is arranged for displaying the options in 

45 a substantially circular-, substantially elliptical- or 
kidney-shaped band. A distance of approximately 
15 cm is about the maximum distance that can be 
reached by a hand-held pointer device without dis- 
placement of the hand of the operator. Distances 

50 from 3 to 10 cm can be easily reached without 
overstretching. 

A preferred embodiment of the apparatus ac- 
cording to the invention is characterized in that the 
apparatus is arranged for displaying the options in 

55 a substantially circular-, substantially elliptical- or 
kidney-shaped band. Easy movement of a hand- 
held pointer device along a closed loop results in a 
roughly kidney shaped curve. As only part of the 




curve may be occupied with areas corresponding 
to presented options an elliptical or circular shaped 
band can be used instead. For symbolic and es- 
thetical reasons the circular form may be preferred. 

When only a portion of the curve is filled with 
options the preferred location for those options to 
be presented is the upper left part of the curve 
when the operator is right handed, and it is the 
upper right part when the operator is left handed. 
Switching from the one mode to the other can 
optionally be provided for in one and the same 
apparatus without much additional effort. 

An embodiment of the apparatus according to 
the invention is further characterized in that the 
pointer device comprises a stylus and means for 
detecting the position of the same. A stylus pro- 
vides an easily hand-held pointer device with which 
fast and accurate movements can be made, result- 
ing in a quick and accurate selection of a desired 
option or a plurality of desired options. 

Another embodiment of the apparatus accord- 
ing to the invention is characterized in that the 
pointer device comprises a touch-sensitive pad ar- 
ranged for detecting the position of an arbitrary 
object on a touch-sensitive surface. In this embodi- 
ment a finger or an object such as a conventional 
pencil can be used for selection of an area cor- 
responding to a desired option. Also other devices 
such as a data tablet can be used for indicating a 
position. 

A preferred embodiment of the apparatus ac- 
cording to the invention is characterized in that an 
option is selectable for performing an operation on 
a previously selected object and in that the appara- 
tus is provided with means for requesting the se- 
lection of an object after an option is selected when 
no object has been previously selected. An opera- 
tion on an object, selected by indicating the cor- 
responding option from the menu, can only be 
pGrfcrmad vvheii an object is selected as well. If 
such an object was not previously selected, the 
operator will be reminded of the fact and will be 
requested to select one of the available objects on 
which the operation can be performed. It is there- 
fore not necessary for the operator to observe a 
certain chronological order in selecting options and 
operations to be applied to the objects. 

While working with a document or while per- 
forming other activities it is normally undesirable to 
have part of the viewscreen permanently occupied 
by the menu. A preferred embodiment of the ap- 
paratus according to the invention is therefore char- 
acterized in that the pointer device is provided with 
first command means for display of the menu and 
second command means for selecting options from 
said displayed menu. The first and second com- 
mand means may be integrated in one button or 
may be, for example, a button and a touch sen- 



sitive tip of a stylus. The first and second com- 
mand means may be different buttons of the point- 
er device, or may even be parts of an input periph- 
eral of the apparatus without a direct physically 
5 connection to the pointer device, such as a key- 
board. 

An embodiment of the apparatus according to 
the invention is characterized in that command 
means are provided for display of the menu of 

10 options at a location on the viewscreen which cor- 
responds to a position selectable by the pointer 
device. By first moving the pointer device to a 
specific area and subsequently activating the first 
command means the portion of the viewscreen that 

15 will be covered by the menu can be chosen by the 
operator. The menu can be removed from the 
screen by various means, such as selecting a 
specific "remove menu" option, activating the first 
command means again, or by selecting an option 

20 which implies that the menu is to be removed in 
addition to the selection of a designated function ^r 
object. 

An embodiment of the apparatus according to 
the invention is further characterized in that the 

25 apparatus comprises further display means for dis- 
playing on the viewscreen at least one sub-menu of 
options along a further curved band and in that the 
apparatus comprises means for providing further 
corresponding areas positioned in a further cor- 

30 responding band which is curved similar to the 
further curved band. Selection of a first option often 
makes it necessary or desirable to select sub- 
options. In an embodiment of the invention the sub- 
menu may already be made visible when the point- 

35 er device is positioned at the corresponding area 
for the first option, but before a selection command 
is given. This provides a better visual Impression of 
what option is going to be selected. It also allows 
to select directly a snh-nptjon and via the sub- 

40 Option the first option, thereby making the explicit 
selection of the first option superfluous. 

A preferred embodiment of the apparatus ac- 
cording to the invention is characterized in that it is 
adjustable to different working statuses and In that 

45 it Is arranged for presenting on the menu a first set 
of options which are independent of the working 
status and a second set of options which are ad- 
justed to a current working status. Options that are 
permanently available will be always displayed at 

50 the same locations in the presented menu. Options 
that have a meaning in a certain working status 
only are displayed exclusively when the apparatus 
is in that status. 

A further embodiment of the apparatus accord- 

55 Ing to the Invention Is characterized in that It is 
arranged for establishing corresponding areas as- 
sociated with options in the menu before displaying 
the options on the viewscreen, and in that an 
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option is selectable prior to display of that option 
on the viewscreen. It may occur that the operator is 
experienced and knows beforehand were to nnove 
the pointer device when the nnenu is activated 
without having to wait for the nnenu to appear 
completely on the viewscreen. In that case the 
selection is correctly performed. In an embodiment 
the display of the complete menu may be inter- 
rupted or skipped. 

These and other, more detailed aspects of the 
invention will be described, by way of example, 
with reference to the accompanying drawings. 
In the drawings shows 

Figure 1 a workstation comprising a viewscreen 

and several input devices; 

Figures 2a and 2b the reach of an operators 
hand while holding a pointer device such as a 
stylus; 

Figure 3 a first embodiment of a menu whereby 
the options are aligned along a curved band; 
Figures 4a, 4b elliptical and kidney shaped 
bands of which a portion is occupied by a 
number of options; 

Figures 5a and 5b an impression of an image 
projected on the viewscreen with the menu dis- 
played at different positions. 
Figure 6 in detail a stylus for use as a pointer 
device; 

Figure 7 a displayed menu with various sub- 
menu's depending on the position of the pointer 
device. 

Figure 8 a partially displayed menu when a 

rapid selection is made. 
In Figure 1 a workstation 10 is shown. This 
station comprises a viewscreen 11, for example a 
CRT or flat panel-screen together with the neces- 
sary electronics circuitry and other components for 
display on the screen of text and graphical informa- 
tion, A keyboard 12 is provided for entering text 
data and various commands into the workstation. 
Additional input devices are shown, a mouse 13, a 
stylus 14 with digitizing tablet 15 and a touch 
sensitive pad 16. A touch sensitive pad and the 
viewscreen can possibly be integrated to form a 
touch sensitive screen. Of the additional input de- 
vices no more than one is necessary in a work- 
station according to the invention. The workstation 
may comprise further devices, not shown in the 
Figure, such as a document scanner, a printer, a 
telephone etcetera. The devices are connected to 
steering and control hardware, and to a power 
supply, both of which are housed in a cabinet 17. 
The cabinet may comprise also a local storage unit 
in the form of a magnetic or solid state memory. 
The workstation may be connected via a link 18 to 
a computer for storage and transmission of data 
and/or may be connected directly or via the com- 
puter to a network to be able to communicate with 



other workstations. Such link may comprise wires 
or be partially wireless. 

For the handling of documents and other ob- 
jects available to the operator commands are to be 
5 given to the workstation via one of the input de- 
vices. A menu of commands may be displayed on 
the screen with options which can be chosen from 
by moving a cursor to the desired option by a 
corresponding movement of the mouse 13 or sty- 
w lus 14, or by the movement of a finger or arbitrary 
object across the touch sensitive pad 16. 

The options are presented on the screen as 
lying on a curved band. As shown in the Figures 2a 
and 2b this band is adapted such that the options 

75 can easily be reached from a hand without lifting 
the wrist from the desktop. In the Figures two 
positions of a hand 20 are shown while reaching at 
points 22a and 22b on a circle 22. The positions of 
the areas to be pointed at should be in a band 

20 within this circle and preferably following its cir- 
cumference. 

Figure 3 shows a possible menu for display on 
the viewscreen according to the invention. The 
menu 30 is displayed as a disc with a number of 

25 options. In the menu three types of options can be 
a distinguished. A first portion, the shaded outer 
band 31, contains a number of main options 31a, 
31b, 31 c, 31 h for the present working status. 
The options are mainly presented by icons. Shown 

30 are, as an example, an icon (31c) for drawing lines; 
for entering text (31 d), for sending a document 
(31 g) or for making a phonecall (31 h). A second 
portion 32 of the disc menu shows a number of 
sub-options, associated with the presently highligh- 

35 ted main option 31c. The presented sub-menu al- 
lows the operator to choose a line type and colour. 
The third portion 33 of the menu, which is adapt- 
able to a certain working status, allows the user to 
choose a specific operation to be performed on the 

40 object that is handled presently. 

Figures 4a and 4b show alternative shapes of 
the menu. Figure 4a shows a kidney shaped menu 
34 of which the main options are arranged in an 
outer band 35 in the upper right hand portion of the 

45 menu. These positions are optimized for a left 
handed operator. Figure 4b shows an elliptical 
shaped menu 36 with the main options in a band 
37 in the upper left hand side, i.e. optimized for a 
right-handed operator. 

50 Each of the three shapes shown, or any other 

suitable shape, can be taken at will within the 
context of the present invention. In Figure 4b a 
central point C for the curvature of the relevant 
portion of the band 37 is indicated. The radius of 

55 curvature D of the band 37 around the centerpoint 
C will be typically less than 15 cm, and preferably 
between 3 and 10 cm. The dimensions are deter- 
mined by the size of the human hand and refer to 
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the positions of the area's to be pointed at with the 
pointer device, not directly to the size of the nnenu 
on the viewscreen. 

For nnost activities perfprnned with a work sta- 
tion nnore than one selections have to be nnade. 5 
For example when a document has to be copied, 
printed or opened for further editing, both the docu- 
ment and an operation have to be selected. For 
communicating to another workstation, a document, 
an address or identification number and a way of io 
transport have to be selected. In a workstation 
according to the present invention no predeter- 
mined chronological order for making these selec- 
tions is to be followed. When print or open is 
selected the tool will operate on the document that ?5 
was preselected before. If no document was 
preselected a request to the operator is presented 
for selecting one of documents available for this 
particular operation, including of course the pos- 
sibility to open a new document. The request may 20 
be presented in the form of a menu with all avail- 
able documents. 

If an option for establishing a communication 
link is selected, for example a telephone line, also 
a source of information to be transmitted has to be 25 
known to the system and the destination. If both 
source and/or destination are unknown a menu will 
be presented containing the possible sources 
and/or the possible destinations taking into account 
the available ones in the present working status. 30 

Figures 5a and 5b show images of the picture 
visible on a viewscreen of an apparatus according 
to the invention. The screen 50 shows two docu- 
ments 51 and 52, together with a disc menu 53 
which contains options that can be selected for 35 
performing operations on the document. Either 
document may be a text document, a graphic 
document or a voice document for example repre- 
sented as many small bars or other symbols which 
indicate volume and/or pitch of the sound. The 40 
screen further shows many other things that are to 
be used, such as a garbage bin, a calculator, or 
icon indicating a phone directory, etcetera. In order 
to be sure that the menu does not eclipse a part of 
the screen with information that should remain visi- 45 
ble, the position of a cursor 54, associated to the 
position of the pointing device, is taken as center- 
point of the displayed disc menu. Figures 5a and 
5b show the menu at different places on the 
screen. In determining the position of the menu 50 
from the position of the cursor care has to be taken 
that the whole menu is on the screen, even if the 
cursor is very close to the edge. In such a case the 
control section of the apparatus will not take the 
cursor position as the centerpoint of the disk menu. 55 

Figure 6 shows a stylus, designed for use with 
an apparatus according to the present invention. 
The stylus 60 comprises two buttons, a first button 
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61 at the side, a few cm from the tip. This button is 
located such that the index or thumb of the oper- 
ator will rest on it. The second button 62, for 
example a microswitch, is located in the tip and is 
activated by pressing the stylus on a surface. The 
position of the stylus can be detected by a digitiz- 
ing tablet 63 and the activation of the buttons is 
communicated, to the control section, for example 
wirelessly by electromagnetic or ultrasonic signals. 

Several modes of selecting one or more op- 
tions from a menu are possible. In a first mode the 
menu is displayed when and as long as the first 
button 61 is activated. Hovering above the desired 
option will highlight it, and it is actually selected 
when the first button 61 released. The menu is 
removed from the screen at the same time. In a 
second mode of operation the menu is also dis- 
played when and as long as the first button 61 is 
activated. Hovering with the stylus will highlight an 
option. Pressing the second button 62 will select 
the command to be performed corresponding to 
the highlighted option, more than one command 
can be performed, by subsequently pressing but- 
ton 62 at several options. A third mode of operation 
uses button 61 to display the menu on the screen, 
options are chosen by pressing button 62. The 
menu is removed by a special "hide menu" option. 

A two button stylus has an advantage over a 
single button stylus in that the second button can 
also be used when the menu is not appearing on 
the screen for example for "writing" on a displayed 
document. 

A menu 70 with several sub-menu's is shown 
in Figures 7a and 7b. In Figure 7a the highlighted 
main option 71 is-for specifying or editing text, and 
a set of sub-options is shown. The sub-options 
include type faces and sizes and the colour or 
shade of the characters and their background. Fur- 
ther options include the selection, copy or insertion 
of portions of text, or to reverse the last action 
taken. In Figure 7b a different set of sub-options is 
shown, which are associated with another main 
option, shown is a main option 72 and the selected 
sub-option 73 is "establish a connection with an- 
other workstation". 

In Figures 8 an additional feature of the ap- 
paratus according to the invention is illustrated. As 
the organization of the menu allows a fast reaction 
of the operator to the options available in the menu 
with few errors, it may occur that the operator 
becomes experienced and knows beforehand were 
to move the pointer device when the menu is 
activated without waiting for the display of the 
menu to appear completely on the viewscreen. 
According to the invention the apparatus is ar- 
ranged to associate firstly area's relative to the 
position of the pointer device at the moment the 
menu is activated to the various options and only 
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later to present the options on the viewscreen. A 
movement of the pointer device to one of the 
corresponding areas and starting the selection pro- 
cedure will result in the option being selected be- . 
fore the menu is fully displayed on the screen. s 
When selection of an option implies removal of the 
menu from the screen the menu will disappear 
before it is completely displayed. Depending on 
the implementation of the display procedure for the 
menu, it may occur that the menu will not appear w 
at all on the screen when such rapid selection is 
made. 

In Figure 8 a menu 80 in the process of being 
displayed is shown. A curved band 81 is shown 
around a central point C, the latter corresponding 75 
to the position indicated by the pointer device at 
the moment the menu is activated. The position of 
two options 81a and 81b, are already displayed on 
the screen. Further options 81c till 81 h are to be 
displayed but not yet present inside the band 81, 20 
the position of these options is indicated in the 
figure by dashed lines. Immediately after the oper- 
ator has activated the menu he moves the pointer 
device to a point D within the corresponding area 
of option 81 f for selecting that option. From pre- 25 
vious experience he knows that the option he in- 
tends to select will appear at this location 81 f. The 
apparatus now allows to select the option before 
actual display of the corresponding icon at location 
81 f takes place. 30 

Claims 

1. Apparatus for the interactive handling of ob- 
jects, such as electronic documents and tools, 35 
which apparatus comprises a viewscreen for 
displaying thereon a menu of options and a 
pointer device for pointing at a corresponding 
area from a plurality of corresponding areas 
each associated with one of the options dis- 40 
played on the viewscreen, and thereby select- 
ing one of said options, characterized in that 

the apparatus comprises means for displaying 
the options on the viewscreen in a curved 
band and in that the corresponding areas are 45 
positioned in a corresponding band which is 
curved similar to the curved band on the 
viewscreen. 

2. Apparatus according to Claim 1, characterized 50 
in that the average radius of curvature of the 
corresponding band is no more than approxi- 
mately 15 cm. and preferably is between ap- 
proximately 3 and 10 cm. 

55 

3. Apparatus according to Claim 1 or 2, char- 
acterized in that the apparatus is arranged for 
displaying the options in a substantially 



circular-, substantially elliptical- or kidney- 
shaped band. 

4. Apparatus according to Claim 3. characterized 
in that the displayed options are presented 
mainly in the upper left hand portion of the 
curved band, or mainly in the upper right hand 
portion. 

5. Apparatus according to Claim 1, 2. 3 or 4, 
characterized in that the pointer device com- 
prises a stylus and means for detecting the 
position of the same. 

6. Apparatus according to Claim 1. 2, 3 or 4, 
characterized in that the pointer device com- 
prises a touch-sensitive pad arranged for de- 
tecting the position of an arbitrary object on a 
touch-sensitive surface. 

7. Apparatus according to Claim 1, 2, 3 or 4, 
characterized in that the pointer device com- 
prises a data-tablet. 

8. Apparatus according to any one of the preced- 
ing Claims, characterized in that an option is 
selectable for performing an operation on a 
previously selected object and in that the ap- 
paratus is provided with means for requesting 
the selection of an object after an option is 
selected when no object has been previously 
selected. 

9. Apparatus according to any one of the preced- 
ing Claims, characterized in that the pointer 
device is provided with first command means 
for display of the menu and second command 
means for selecting options from said dis- 
played menu. 

10. Apparatus according to any one of the preced- 
ing Claims, characterized in that command 
means are provided for display of the menu of 
options at a location on the viewscreen which 
corresponds to a position selectable by the 
pointer device. 

11. Apparatus according to any one of the preced- 
ing Claims, characterized in that the apparatus 
comprises further display means for displaying 
on the viewscreen at least one sub-menu of 
options along a further curved band and in that 
the apparatus comprises means for providing 
further corresponding areas positioned in a fur- 
ther corresponding band which is curved simi- 
lar to the further curved band. 

12. Apparatus according to any one of the preced- 
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ing Claims, characterized in that it is adjustable 
to different working statuses and in that it is 
arranged for presenting on the nnenu a first set 
of options which are independent of the work- 
ing status and a second set of options which 5 
are adjusted to a current working status. 

13. Apparatus according to any one of the preced- 
ing Claims, characterized in that it is arranged 
for establishing corresponding areas associ- w 
ated with options in the menu before display- 
ing the options on the viewscreen, and in that 
an option is selectable prior to display of that 
option on the viewscreen. 



14. Apparatus according to Claim 13, character- 
ized in that it is arranged for interrupting dis- 
play of the menu when an option is selected. 
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